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ABSTRACT 

Attitudes toward school and three personality 
^characteristics (introversion, impulsivity, and emotional stal>ility) 
were measured in Swedish students from 60 sixth grade classes, ine 
ScSool and We Questionnaire (SAW) and a Swedish translation of tne 
High School Personality Questionnaire were completed by. 1,319 
students. Secondary data analysis was conducted at two levels of 
aggregation: pupils within classes, and differences between classfe;. 
The same factors were found at both levels: (1) attitude toward 
school and schoolwork; (2) attitude toward teacher ; (3) relations 
wiyi .j5>^lassmates; (4) social relations in the entire class; and (5) 
*clas3 behavior or discipline. At the two levels of data analysis, 
th^se-' factors accounted for different amojints of variance. At tue 
class level, factors reflecting attitudes toward teacher and 
^characteristifcs of the entire class were strong; while at the 
individual level, factors reflecting school attitudes and the 
individual^nS relations with clas'smates were strong. Impulsivity 
accounted for the most variance in SA^^ scores. Within a class, 
inpul^ivity ^was negatively correlated with attitudes to war d^ school 
and tea^cher. Between-class analysis indicated a high negative 
correlation between impulsivity and class discipline. Introversion 
was negatively correlated with peer relations, while, stability was 
positively correlate'd. (Author/GDC) 
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ABSTRACT 



The responses of the pupils in 60 6th grade classes to 
a 40-itein questionnaire -assessing attjjitudes towar(^s the 
school, the teacher and the classmates "jTs factor analyzed 
at two levels of aggregation, classes and pu^ls-within- 
classes. The same factors were found at both ]>evels but 
they accounted for different amounts of vsi^,ance: At the 
class level factors "reflecting attitudes towards the 
tocher and characteristics of "the class as a Whole were 
st^ong^, while at the individual 'level factors reflecting 
attijtudes towards the school an^-the individual pupil^s 
relations to the classmates . were strong.. Relations 
between , personality vari^ble^ and the attitude scales 
are also studied ^t the two Idvels o-f aggregatio^ ^and 
implications of the results for the measurement o'f 
personality are discussed. ^ 



INTRODUCTION 



With few exceptfons, statistical analyses of educational 
research , studies are based on the individual pupils'scores . 
However, most educational processes do take place with the 
pupils orga?ni2ed into classes; thus the pupils are not 
independent units of observation but they do have a more 
or less common history of experience. It has been argued 
•(e.g. Peckham, Glass & Hopkins, 1969) that 'when classes 
I a^e sampled, class means should be analyzed instead of 

pupils'scores However , Cronbach (1976) claimed that 
neither analyses at tile individual level, nor analyses 
at the class level yield a sufficiently complete picture; 
instead the hierarchical nature of the observations 
should be clarified and the individual scores decomposed 
into components for different levels of aggregation, to 
obtain separate estimates for different levels. It was 
, shown, both theoretically and in empirical examples, that 
patterns cff results fi^om regression analysis, covariance 
analysis, and multivariate -analys is etc. may be drasti- 
cally different at different levels of aggregation. 

/ 

The present paper presents witj^in-class and between-class 
^factor analyses of a questionnaire designed for assessing 
attitudes towards the school, the teacher and the cl^ss- 
mates. Some or all of these aspects can be suspected to 
^be/^^s§hsitive to variation between classes; an ordinary 
fcthr analysis based on the individual pupils "scores is 
therefore likely to fail to reflect the true dimensionality^ 
of the responses. 

The paper has^both methodol^ical and a subst'a;ntive 
purpos^ and to add to both 'of these, if-elations bef^wecn 
the dimensions established in the factor analysis and 
pr^FSonality v^riable:^' will^ be studied. 



METHOD 
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Instruments 



The attitude questionnaire was originally constructed 
by Johannesson (I960), under the name Our class? here, 
however, a somewhat shortened version, developed within 
the DPA-project (Didactical Process Analysis, Bredange 
et al.,1971), has been us^d. The questionnaire y^H be 
referred to as the SAW questionnaire (The School and We, 
as would! be the literal English translation of the 
Swedish name) . 

The SAW contains 40 questions or assertions, eadh of 
whicl^ is to\ be answered through cirey.ng one of the 

5 alterna^J^es ALWAYS ,^ OFTEN, SOMETTMES, SELDOM and 
NEVER. Th^e are both positKLve and negative assertions, 
but the responses were coded in such a wa^ that a higher 
code throughout represents a more positive attitude. 

When the SAW was constructed the questions were classi- 
fied inte three groups to yield scores on three different 
scales: one assessing attitude towards the school (18 
items, 7 -positive and 11 negative); one measuring atti- ' 
tude towards the teacher (9 items, all positive)? and 
one measuring attitude towards the classmates (13 items, 

6 positive and 7^ negative) . The grouping was validated 
on the basis ofymeasures of internal consistency, but 
the/^imensionality of the questionnaire has never been 
invest:igated with factor analysis. 

Pupil personality was measured with a translation into 
Swedish of the High School Personality Questionnaire 
(HSPQ, Cattell, Coan & Beloff ,19 57 ).' However , the 13 
dimensions pu^ortedly measure*, by the- HSPQ could not 
be refound in factor analyses of the version used? 
therefore the items were reorgnized into three scales. 
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The Tbales could be interpreted as measuring Introversion, 
Impulsivity and Emotional stability. The Introversion/ 
scale consists of 12 items, most of which measure the 
sociability aspect of introversion. The imnulsivity scale 
contains 16 items, most of which reflect adventerousness 
and weak' superego control. The Stability scale consists 
of 18 items asking about the tendency not to get em^otio- 
nally upset and nervous. * 

Subjects , 

The data analyzed here were originally collected within 
the DPA-i^^t^ject' (Bredange et al., 19^1), and are here 
only us^d for -secondary analyses. / . 



The DPA-project compr^ised 60 classes in grade 6, with in 
all 1601 pupJils. It was, however^ impossib^te to obtain 
complete data from all the pupils. The SAW questionnaire 
was answered by 1435 plJpils, which is theVnumber of. 
pupils on which the factor analyses are based. Class 
sizes varied between 17 and 30. '\ 

The analysis of the relattonstvip between the HSPQ scales 
and ^ the SAW will, however, beVbased ori a somewhat lower 
number of pupils? 1319 •'pupils answer-ed both these 
questionnaires The reason for this additional attrition 
of the group is that the q'uestionnaires were administered 
at two .different occasions. y 

• - ' ■ ■ / 

Statistical analysis ' ^ . 



^'he da^a will ^be analyzed at two levels of aggregation, 
pupils'-within-classes and between classes. A third level, 
school, could in principle be recognized in the data, \ ' 
/but since only few schodl:s ^re represented with more 
than one class, analyses taclcing .into account this third 
level, would not be ^informative^ v- 



/ 



Cronbach (1976) recommend that; in two-level analyses, 
each pupils' score is transformed inte two components: 
the class mean and the deviation of the raw score from 
the class mean. Covariance matrices are then computed., 
using the class means for the between-class covAriance 
matri;j^j> and the deviation, scores for the within-class 
matrix? in both cases, however, with ther-total number 
of pupils " as the number of observations . This means that the 
estimates are weighted in relation to the number^ of 
pupils, and the. ordinary j^ooled cqyarianbe matrix is 
obtained' as the .sum of the between-class and within- 
class covariance matrices^ 

' ^ ^' 

An estimate of the intraclass cprrelgiition for a variable 

\ • ^ " " ' • , I ' ' 

can be obtained througWf orming tKe variance ratio for 

the between-class variance afid tb<^total y-^riance. This pi 

estimate is biased , * s:^nbe it doeg-;-^^e into account ±he ' S . 

variance between classes resu^til^-^t^j^m 3?andom assignment ' • 

of pupils to- classes ' (HarnqvisWf^i^^fr-^ However/^ Cronbach ^ 

(1976) argued/ that pupils within^ -qy<a$^^es must be . considered ^ 

./ ^ . V, ' ■ ■ , \ • 

as fixed?-e^h class has a ' up'iq^&Jii.^tpry -and tjierefore 

it iV*notreaso^v^le to specjj\ate, about^Nt^e poss 

results of ^noth^ particular assigfurferiil^ qf. pupils. 

r . . r . ^ , 

The factor analyses \7>ir be based on scale-free covariance 
matrices, in which ^ch element'-in th^ covariance matrices 
for the within- and between-class levels is divided with 
the product' of the standard . deviationis , at i;he pooled • 

level, for the pair of variables involved. Th^ diagonal ^ f 

»i ■ 

contains for the between-class level the intraclass 
correlations and for the within-class level, 1- mimis the ^ 
intraclass correlation. These two matrices su# to the 
ordir^ry correlation mabrix for the pooled data. (cf. 
Cronbach', ''1976; Harnqvist, 1978) . Thus the tot^ V a.r i a n c e. 
factor analyzed at the between-class level is the sum 
of* the- intraclass correlations, and, J:he rGrT|aind®r of tho^ 
variance is antijlyzed at the wtthinM?]ass level. 

The EFAP program of Joreskog and Sorbom (1976), was 

ulsed to compute" maximum likelihood solutions, at the ^ y 



within-class and between class levels, under different 
assumptions as to the number of factors, ^nd these 
solutions were followed by Varimax rotations. The maxi- 
mum likelihood approach allows a statistical test of > 
the' hypothesis that a certain number of comiftoh factors 
is sufficient to account for the structure of correlations. 
Considering, among other things, the problems' in deter-^ 
mining the actual degrees of freedom, howevej;-, little 
.importance was attached to these statistical tests. 

RESULTS 



Results will! be presented from 5-f actor solutions, since 
the factors in those solutions seemed to reflect dimensions 
of interest from a substantive point of view. Table 1 
presents th^ items with high loadings in the 5 factors in 



Insert Table 1^ about here 



the between-class and within-class analyses, along with 
the intraclass correlations; Rather surprisingly, the^ 
same items tended to load highly at both levels. In the 
few cases where an item loadec^ highly in the analysis 
at one level only it has been included in Table 1 anyway. 

Factor 1 . is loaded highly by items measuring attitude* 
towards the school and schoolwork and it wili t^e called 
the School fcictor. The loadings in' the within-class 
analysis generally are 2 to 3 times as large as those / 
in the between-class analysis , but the factor is clearly 
e:^tablished at both levels. " ' • 

Factor 2 is defined by items measuring attitudes to, and 
perceptions of, the teacher, and it will be called the 
Teacher factor. The loadings in the between-class- analysis 
tend to Almost as large as those in th^ within-class' 
analysis, and there are very sizeable intraclass correla- 
tions for moat of the items with a high loading in this 
factor. Eacrf class had a different teacher so a large - 



between-class variance is to be expected, but it is also 
interesting to note that there are systematic individual . 
differences within the classes in the perception of the 
teacher. . \ . 

Factor 3 is loaded highly by a group of items aski'rig 
about the individual pupil's rJiations .to classmates, 
and it will be labelled Relations to classmates^ . The 
loadings at the within-cl^ss level are 3 to 4 times as 
large, as those at the between-class level, and the items 
loading this factor have the lowest intraclass correlations 

< 

Also factor 4 is defined by items asking about social 
relations; in contrast with factor 3, however, ^ these items 
refer, to social relations within the class as a whole. The 
factor will be referred to as the Class relations factor. 
The loadings at the within-class ' level are two times, or 
less, as large as the loadings at the 'between-class level, 
and the intraclass correlations are of ar^ intermediate 
size. 



Factor 5, finally, is loaded higfkly by items referring 
to the behaviour or discipline of the class, and the -factor 
will be called the Class discipline faq^or. Both the 
intraclass correlations and the loadings in the between- 
class analysis vary greatly for the items loading this i 
factor, but for some items they are sizeable. \ 

The, factor analysis thus shows that the items' originally 
classified as measuring attitudes towards the school and 
the teacher each ,€^rm a separate factor. -However, the 
items constructed to measure- attitudes towards classmates 
in fact form 3 factors: One reflecting the individual ] 
pupil's relations to classmates; one refle^ifig social 
relations within the 'class; and one reflecting the 



discipline of the class. 

/ 

u * 

* . 

These 5 factors could.be identified at both levels, even . 
though the relative size of the loadings at the wi-thin- 
cliass level and the between-class leWl ife ^different for 



the factors. This appears in greater detail from Table 2 
where the amount^of variance explained by the factors at 
the two levels as shown. 



Insert Table 2 about here 



In the between-class analysis the Teacher factor accounts 
for most variance, then follows the School factor, the 
Class discipline factor, the Glass relations factor and 
the Relations to classmates factor. In the within-class • 
analysis the School factor is the one accounting for most 
variance, followed by the Teacher^ factor, the Relations 
to classmates factor, the Class relations factor and the 
Class disciplli^e factor. Thus even though it is possible 
to find the same factors at both levels of the hierarchical 
analysis, it is obvious that different sources of variance 
influence the factors differently. 

To study correlations, at the within-class level and .the 
between-class level, between the personality variables and 
the attitude factors, 5 scales were constructed through 
assigning each item in the SAW questionnaire t'o the factor 
it loaded highest. Statistical characteristics of the - 
scales are presented in Table 3. As can be expected the 



Insert ^Table 3 about here 



intraclass correlations vary greatly between the scales, with 
the Teacher scale having the largest intraclass correla^ 
tion and the Relations to classmates scale having the 
lowest intraclass correlation. The personality variables, ' 
characteristiMjijfif , which have also been entered in Table- 3, 
tend to hav^-fllFlowest intraclass correlations; as is evident 
from the 'F-ratio^ from one-way analyses of variance with class 
as^ the factor they are siqnif icant , however , for both 
Lntroversion and Impulsivlty. 



Table 4 presents correlations between the SAW scales and 
the personality variables at the two levels. The correlations 
have been computed from between-class and within-class co- 
variance matrices which were standardized to have uniti^^ 
in the diagonal. i ^ . 



Insert Table 4 about here 



Impulsivity is- the personality variable which accounts for 
most variance irv the SAW scales. In the within-class 
analysis there are rather strong negative correlations 
with the School and Teacher attitude scales? this does 
not to the same extent hold^ true at the class level, so 
had pooled correlations been computed instead, weaker 
correlations would have been found with Impulsivity. 
In the between-class analysis there is a rather high 
negative correlation between Impulsivity and the Class 
discipline scale. 

The other personality variables yield few correlations 
worth mentioning. It can be observed, however, that 
Introversion both at the class level and at the individual 
level is negatively^ correlated with the Relations to 
classmates scale and that there, at the class level, is 
a negative correlation 'between Introversion and the 
Social Relations scale. Stability is positively correlated 
with Relations to classmates, both in the,^be.tjve^-class 
analysis and in the within-class analysis. 

DIS CUSSI ON AND CONCLUSIONS 

^ ^ 

The factor analyses at. the two levels of aggregation 
resulted in the same factors at both levels, in spite of 
the fact that no constraints, other than those dictated 
by the number of factors and the Varimax criterion, were 
imposed. An empirical . example that the same factors arc 
not necessarily found at both levels in" this kind of 
analysis is given by Harnqvist (1978). 
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But it was found that the two levels contribute differently 
to the factor variance: There are factors mainly influenced 
by^ differences between pupils within classes such as the 
Relations t^ classmates factors and the School factor, but 
there are also factors heavily influenced by differences 
between classes, such as the Teacher factor and the Class 
discipline factor. In an ordinary factor analysis, disregar- 
ding the hierarchical natute of the observations, it would 
necessarily have been assumed that only differences between 
pupils are reflected in the factor variance. 

It appears that the most interesting^pattern of correlations 
wLth the personality variables is found at the class level: 
Impulsivity is correlated with Class discipline, and Intro- 
version with Soci^al delations and Relations to classmates. 
It is quite interesting that personality variables, which 
are usually taken as purely individual measures, do show 
interpretable correlatiohs also at a higher Xevel of aggre- ■ 
gatioh. 

Two interpretations can be suggested to account for this. 
In the first place it is clear that even " if assignment to 
classes is random there will be differences between the 
classes with respect to personality and it is possible 
that even \ji^light differences in the compo^iton of the 
classes can have important effects on the flow of events 
in the class. But, secondly, it must also be pointed out 
that both questionnaires were answered while the pypils 
attended the same' class; therefor the measurement of 
personality \is not independent of class . For example , if 
a teacher places only little weight on the social relations 
within the class, this is also likely to result in a 
higher mean • of the class on .the introversion * scale . 

Since in this c^se both questionnaires were ^swered 
while the pupils attended the same class it is not possible 
to decide which of these interpretations of the correla- 
tions at the class .level is the correct one. However, 
since there were significant" intraclass correlations 
also for the personality variables it does seem that ' 



there may be an effect of class belongipgnesS 6n the 
measurement: of personality. , * 

The it^s in,,the HSPQ have been analyzed for class 

effects. 7 There were &nly few significant intradla^s 

^corifer^tion&> but tfor a group of items with Specific 
refierence to the school and the class, significant 
intraclass ^cor^^latioris were fourld. The conclusion 

-that such items with a^ specif ia' situational reference 

.'are sensitive, to class effects does have implicatiorl's 

^ for. the' measurement of personality. 

Bennett and Yt>ungman (1973, cf*. Bonnet, 1973) criticized^- 
:th^ Ju'nior Eysenck 'Persorralitfy « Inventory for asking ^ 
questions ' framed in too general terms and they claimed* ^ 
th^t "In the school setting £t seems likely that 
institutional demands are sufficiently strong to swamp 
the/Qffects of individual differences in personality. 
In siach a jsituation a general inventory liJje the JEPI 
is of limited 'utility anS validity... It would, therefore, 
seem more useful to design inventories whicih^ have a 
clear meaning in the particular situations encountered" 
(Bennett & Youngman, 1973, p. 233). The rationale behind 
this suggestion is sound* enough, but if proper account 
is not taken of the class effects which are likely to 
result from such an approach this may create more 
severe problems in educational research than those 
caused by attempts to .m^'easure personality without clear 
reference to context. Since classes are different, refe- 
rences to specific situations will have different meaning 
'for the pupils in different classes, and such differences 
will enter systematically into the responses. If such 
data are analyzed as individual data there is a great 
risk that spurious relationships will be found between 
the. personality variables and other variables, such as 
achievement and attitude -variables . 

To guard against such spurious relationships, and also to 
study relationships at the class level in their own right, 
the methodology OTemplified in this paper does seem well 
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Table 1 



The items in the SAW questidnjiaire with high loading^ in 
the two-level factor-analyses,^ Factor loadings* shown are 
varimax-rotated loadings from maximum likelihood solutions". 



Item 



Factor* 1 



'5. It is fun to go 
to school 



Loading ^ 

^Intraclass 
Within s Between coirrelation 
classes classes^ , 



>.73 ^ .27 



.11 



It is boring to go 
to school 



.73 



.29 



.11 



25. I find the lessons 
boring ^ 

22. 'work at school .is dull 
and monot6nous 



.67 



.67 



.29 .13 



.29 



.12 



18 . I think that the lessons 
at school pass away slcwly 



.58 



.25 



.10 



I think thatathe work on 
the lessons is fun. 



.61 



.21 



.09 



29 . I want to leav^e school 
earlier in the day 

30. I think that the lessons 
at school pass away fastly 

4. In the mornings I want to 
stay heme fron school 

15. In our class the lessons 
are fun and interesting 



.53 



.50 



.50 



.48 



.21 



.20 



.18 



.19 



.09 



.07 



.08 



.15 



21. It would be more 'fun if we 
were allcwecJ to do v\^at we 
want at the lessons 

11. It would be better to have 
a job than go to school 



^47 



.23 
.18 



.11 



.09 



37 . ■ Work at school is nice and 
shews variation 



,55 



.19 



.12 



Factor 2 



33. Our teacher is nice and kind 



.56 



.53 



.36 



17. Our teacher is calm and in 
gpod tanper 

35. Our teacher keeps hisAier 
premises 



,54 



.51 



.48 



.41 



.30 



.27 



Table 1 . continued 

8- 



Itan' 



^^B^- intraclass. 
Within, Between correlation 
classes classes 



.23^ 

.19 / 

.15 '/ 

"' £ , 

.07 , . . 



38. .Our teacher tr'eats all 

pupils alike - ^ - ^ 

10. CXor teacher listens to 
cur questions' 

13.- Our teacher helps us. much 

Factor 3 

23. My cl^snateg 




19. I. get enemies ( 
clasanates dur^jig 

breaks / 

.y 

24. I feel forlorn at school 

2.0. All itty "clasanates are kind 
to me 

Factor 4 



26. In our class all the 
pupils are good friends 

27. In our class the pupils 
help each, other 

20. All my clasanates are kind 
to me . • 

39. In our class we are together 
during the breaks 

32. In our. class, the pupils 
. contend with each other 

Factor 5 

16. In our class we neglect school 
work 

7 . During . the lessons we are 
calm and quiet 

14. Druing the breaks the 

pupils in our class fight 



32. In our class the pupil 
;, contend with each other 



40. In our class we do exactly 
. as the teacher says 



.47 

.48 
.47 

:64 

.55 
.54 

.52 



.58 
.49 

.38 
.34 

,28 



.27 



.43 



.37 



.23 



.37 

.32 
.31 

.22 



.13 ' .07 



.13 ' .06 



.11 



,28 



.29 



.17 



.25 



,23 



.43 .2Z 



.36 



.13 



.19 



.24 



.07 



.11 



.14 



.07 



.13 



.12 



.13 



.26 



.13 



.12 



.18 



" Table 2 Contributions oi variance by the* factors in the 
within- and between-class analyses. 



Within classes Between 'elasses 



Factor Amount^ per cent Amount per cent 



School 


5.31 . 


J 15 


1.06 


20 


Teacher ? 


. .2.7? 


8 


1 .77 

• :# 


33 


Relati'^ks to 










classmates 


1.73 


5 


• U.8 - . 


3 


Class relations 


1.32 . 


4 


.44 


8 


Class discipline 


.94 . 


3 


.43 


8 


Total 


. 12.05 


. 35 


3.88 , 


72 



1) The percentages have been computed from the total 
amounts of variance analyzed, 34.6 and 5,4 for the 
within- and between-class analyses, respectively. 



Table 3 Characteristics of the scales measuring attitude 
and personal/£l;y. , ' ^ • 



1^ 



"Scale 



No of items 



Intraclass 
correlation F-ratio 



1) 



Attitude variables 

School ' V 15 

Teacher - 12 

Relations to class- 

mates '. 6 

Class relations 3 

Class discipline 4 



,16 
,32 

08 
17 
22 



4 .24 

11.21 

<f 

1.91 
3.85 
6.93 



Personality variables 

Introversion , 14. 

Impulsivity 16 

Stability 18 



,06 
0 5 



1.42 
1.51 
1.25 



1) The F-ratios are computed in oneway analyses of 
variance with class as- factor, critical value F 
t59, ~) = 1.39. 



95 



Table 4 Correlation^ between the personalLty^^riables 

and the attitude variables .at witnin- knd between- 



class levels. 



Introversion Impulsivity , ♦ Stability' 

Within Between Within Between. wfthin ' ^feetween 



School 


-.04 


.06 


-.38 . ■ 


•--.16^^ 


' -.01 


-.0 5 


Teacher 


.03' 


.06- 


■ -.3 2 


.-.04 • 


.01 


■^.03. - 


Relations to 
classmates 


-.27 


-.29 


. -.la • 


-.23 


.28 


.28 _ 


Class, 
relations 


-.15 


-.28 


-.11 


-.22 


• .'.09 


-.10- 


Class 

discipline 


.02 


.07 • 


-.21 


-.34 


.10 


- . 16 



18 
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